Skip to content

chore: ⬆️ Update TheTom/llama-cpp-turboquant to c26cbdffcf6fc9b7430cd6b117757e9a3f70b7ea#10235

Open
localai-bot wants to merge 1 commit into
mudler:masterfrom
ci-forks:update/TURBOQUANT_VERSION
Open

chore: ⬆️ Update TheTom/llama-cpp-turboquant to c26cbdffcf6fc9b7430cd6b117757e9a3f70b7ea#10235
localai-bot wants to merge 1 commit into
mudler:masterfrom
ci-forks:update/TURBOQUANT_VERSION

Conversation

@localai-bot

@localai-bot localai-bot commented Jun 10, 2026

Copy link
Copy Markdown
Collaborator

@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 2 times, most recently from 33783df to 95d0d4f Compare June 11, 2026 20:56
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 73eb521daebc85da7c91d37178940b99a5524cf6 chore: ⬆️ Update TheTom/llama-cpp-turboquant to f0d5cc9f71babf7cba8679a06efd602d26b70b06 Jun 12, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 2 times, most recently from 7c48dfd to 2467c24 Compare June 13, 2026 20:34
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to f0d5cc9f71babf7cba8679a06efd602d26b70b06 chore: ⬆️ Update TheTom/llama-cpp-turboquant to 7985f6b90bf19881ab7c7a8444954e91cae36056 Jun 13, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 4 times, most recently from ba90636 to b2603de Compare June 17, 2026 20:50
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 7985f6b90bf19881ab7c7a8444954e91cae36056 chore: ⬆️ Update TheTom/llama-cpp-turboquant to 35ac80d55b8e8e2a0d179413caddc2622b54c248 Jun 17, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch from b2603de to b863245 Compare June 19, 2026 20:37
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 35ac80d55b8e8e2a0d179413caddc2622b54c248 chore: ⬆️ Update TheTom/llama-cpp-turboquant to 4595fff0bbd15ee01663699b788eea70e7e1cd69 Jun 19, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 6 times, most recently from fe42778 to beacee4 Compare June 24, 2026 20:45
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 4595fff0bbd15ee01663699b788eea70e7e1cd69 chore: ⬆️ Update TheTom/llama-cpp-turboquant to a33ef00b13476e9c609caecc3c1c015b8615011d Jun 24, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 2 times, most recently from a21dc73 to 2de5c5b Compare June 26, 2026 21:24
mudler added a commit to ci-forks/LocalAI that referenced this pull request Jun 27, 2026
…10235)

The fork a33ef00b HIP-ported ggml_cuda_copy2d_across_devices() itself
(it now guards the cudaMemcpy3DPeer fast path with
#if !defined(GGML_USE_HIP) && !defined(GGML_USE_MUSA) and falls back to a
plain 2D device-to-device copy), so the former copy2d hunk's anchors went
stale. Retire that hunk and re-anchor the still-needed event hunk:
ggml_backend_cuda_device_event_new() still uses plain cudaEventCreate,
which ggml's HIP shim does not alias, so keep the cudaEventCreateWithFlags
(cudaEventDisableTiming) rewrite. Validated with apply-patches.sh against
a fresh clone at the pinned commit.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-8 [Claude Code]
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch from fd438a1 to 787c635 Compare June 27, 2026 22:32
mudler added a commit to ci-forks/LocalAI that referenced this pull request Jun 27, 2026
…10235)

The fork a33ef00b HIP-ported ggml_cuda_copy2d_across_devices() itself
(it now guards the cudaMemcpy3DPeer fast path with
#if !defined(GGML_USE_HIP) && !defined(GGML_USE_MUSA) and falls back to a
plain 2D device-to-device copy), so the former copy2d hunk's anchors went
stale. Retire that hunk and re-anchor the still-needed event hunk:
ggml_backend_cuda_device_event_new() still uses plain cudaEventCreate,
which ggml's HIP shim does not alias, so keep the cudaEventCreateWithFlags
(cudaEventDisableTiming) rewrite. Validated with apply-patches.sh against
a fresh clone at the pinned commit.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Assisted-by: Claude:claude-opus-4-8 [Claude Code]
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 3 times, most recently from db5dabc to b730ea9 Compare June 30, 2026 20:44
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to a33ef00b13476e9c609caecc3c1c015b8615011d chore: ⬆️ Update TheTom/llama-cpp-turboquant to 0c8fcfe737ac7cfa79a5b8558024fd7ede79010f Jun 30, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch from b730ea9 to 7a1fcf7 Compare July 1, 2026 20:40
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 3 times, most recently from 2e78b9b to 88a3c62 Compare July 6, 2026 21:34
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 558c6b78e4f8cf92ec19539ff89b6d13f4183feb chore: ⬆️ Update TheTom/llama-cpp-turboquant to 3d42fa1eb6e9f35c80ac86084637f574c3c764db Jul 6, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 3 times, most recently from 9777cc8 to 08694ce Compare July 9, 2026 20:38
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 3d42fa1eb6e9f35c80ac86084637f574c3c764db chore: ⬆️ Update TheTom/llama-cpp-turboquant to 206e18efc2966e8f0176e6f7012f8f9610195937 Jul 9, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch from 08694ce to 6f316dd Compare July 10, 2026 20:34
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 206e18efc2966e8f0176e6f7012f8f9610195937 chore: ⬆️ Update TheTom/llama-cpp-turboquant to c3e6dbb13d40e2e42f7a964bd5d745fbf86e4495 Jul 10, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 2 times, most recently from f4319bb to 8d7cfce Compare July 12, 2026 20:19
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to c3e6dbb13d40e2e42f7a964bd5d745fbf86e4495 chore: ⬆️ Update TheTom/llama-cpp-turboquant to 4503343ffc05c09f6b50c309c8ecbabb49c66ea2 Jul 12, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 2 times, most recently from 92f2c17 to 2fd33b5 Compare July 14, 2026 21:10
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 4503343ffc05c09f6b50c309c8ecbabb49c66ea2 chore: ⬆️ Update TheTom/llama-cpp-turboquant to f27268914e948aec208937e8b867a68d85f886ce Jul 15, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 3 times, most recently from fa87b16 to edf201b Compare July 17, 2026 20:23
@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

The current red matrix is a real patch-refresh failure, not infra: upstream commit f2726891 already incorporated the HIP/MUSA-safe ggml_cuda_copy2d_across_devices path, so the first hunk in 0001-hip-guard-copy2d-peer-fastpath.patch now rejects at the old line 1933. The second hunk is still required: ggml_backend_cuda_device_event_new still calls unaliased cudaEventCreate and must use cudaEventCreateWithFlags(..., cudaEventDisableTiming).\n\nI refreshed the patch locally and verified git apply --check against the exact bumped SHA, then applied it and confirmed the resulting event call. The fix is simply to remove the now-upstreamed peer-copy hunk, update the remaining hunk anchor to ~5795, and update the patch description. Commit prepared locally: b4a9278b (8 insertions, 40 deletions).\n\nI attempted to push this verified commit directly to ci-forks/LocalAI:update/TURBOQUANT_VERSION, but GitHub returned 403 for the authenticated localai-org-maint-bot, so I cannot update this fork-owned head branch. @mudler please grant the bot access to ci-forks or apply the patch refresh there; after that the failed build jobs should be rerun.

@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch from edf201b to 568cf0f Compare July 18, 2026 20:19
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to f27268914e948aec208937e8b867a68d85f886ce chore: ⬆️ Update TheTom/llama-cpp-turboquant to 471fb4ec8fc75bbebbcb81d4d6b5e260e9c6e831 Jul 18, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch from 568cf0f to efc2404 Compare July 19, 2026 20:20
@localai-bot localai-bot changed the title chore: ⬆️ Update TheTom/llama-cpp-turboquant to 471fb4ec8fc75bbebbcb81d4d6b5e260e9c6e831 chore: ⬆️ Update TheTom/llama-cpp-turboquant to c26cbdffcf6fc9b7430cd6b117757e9a3f70b7ea Jul 19, 2026
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch 2 times, most recently from 965bd90 to 4b35fc2 Compare July 22, 2026 01:09
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@localai-bot
localai-bot force-pushed the update/TURBOQUANT_VERSION branch from 4b35fc2 to 7d6bfb4 Compare July 22, 2026 21:49
@mudler

mudler commented Jul 22, 2026

Copy link
Copy Markdown
Owner

@localai-org-maint-bot supersede this one in a new pr

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants